Want to jump to a specific question?
- What is the most popular result?
- Do results vary between countries?
- Are all questions created equal?
What is the most popular result?
Unfortunately, within this data set, Open Psychometrics did not provide us with specific results (e.g. SCUEI), but with a bunch of numbers. In fact, this is what the data looks like:
I’ve only selected the first 6 responses. Not too bad, right? But, you’ve gotta imagine about 50 more columns, and about a million more rows. It’s a little more intimidating now, but we’ve gotta start somewhere >:)
First, let’s calculate the scores for the Extroversion personality trait. We can do this by summing up the scores of the 10 EXT (standing for EXTroversion) questions. Of course, it should be noted that answering a ‘4’ or ‘5’ on a EXT question doesn’t always mean that a user is more extroverted. For example, EXT Question 2: I don’t talk a lot vs EXT Question 1: I am the life of the party.
So, we’ll need to make sure to add and subtract scores as necessary - I’ve arbitrarily made the decision to add ‘points’ if a question symbolizes extroversion, while subtracting ‘points’ if a question is correlated with introversion.
Hence, after adding up all the scores, any positive score (> 0) will mean that the user receives an ‘S’ for Sociable, while a negative score (< 0) would result in an ‘R’. If their score is 0, then they’d receive an ‘X’, as their results can’t really be evaluated since they’re perfectly in-between!
Sample table of results, where extscore and extletter are calculated using the raw data:
Visualizing this data into a graph:
I’m going to refrain from any analysis on WHY there’s more R’s compared to S’s until the final results. But, it’s a pretty 50/50 split!
The same process will be applied to the other personality traits1, with the graphs of results located below:
After getting these values, we can now combine them together to get the results. I’m also going to limit this to the top 25 results… or else the data just gets super messy.
WOOO! Congratulations to the XXOAI family for being among the most common result out of 243 possibilities! If you’d prefer to see a more numerical visual, I’ve provided a table containing the 10 most common results below:
| Results | Amount of Responses | Percentage of People |
|---|---|---|
| SCOAI | 160758 | 15.832892 |
| RLOAI | 132305 | 13.030585 |
| RCOAI | 106355 | 10.474796 |
| RLUAI | 98833 | 9.733962 |
| SLOAI | 96998 | 9.553234 |
| SLUAI | 72098 | 7.100859 |
| SCUAI | 54528 | 5.370407 |
| RCUAI | 40040 | 3.943499 |
| RLXAI | 14370 | 1.415287 |
| SXOAI | 11818 | 1.163943 |
We can also look at the ‘average’ scores of each personality trait.2
EXT EST CSN AGR OPN
avgscore 0.52 -0.88 2.746667 14.46667 6.493333Let’s try to analyze these results.
Extrovertism
There seems to be a nice mix of S(ocial) and R(eserved) values, which is representative of the larger population. It’s the most balanced compared to the other 4 traits, and actually mirror what is expected. This is likely because it’s quite easy for oneself to decide if they’re ‘introverted’ or ‘extroverted’, and the questions (e.g. “I start conversations”) tended to be quite straight-forward and are experiences that they would’ve gone through in their daily life.
When looking at TABLENUM, There are technically about 40000 more R’s than S’s. If I wanted to stereotype (which is an inevitable part of ‘absolute letters’, rather than 70% R vs 30% S), maybe the S’s aren’t as likely to spend 20 minutes on an online test, compared to R’s, who are more likely to be holed up in their room.
**Neuroticism* *
Once again, a solid sample of results between C(alm) and L(imbic). I think it’s similar to extrovertism, where it’s quite easy to determine how strongly you feel your emotions, and your ability to control them.
Scrolling up to TABLENUM, there are more limbic people, compared to calm, by about 60000. I’m not really surprised, in fact, I’d think they’d be more limbic people, as society slowly puts more emphasis on mental health and actually exploring our emotions. This could make us more moody - we actually try to work through our emotions, rather than repressing them, and pretending to be calm. However, it could also be the other way around! By engaging with our emotions, we can better understand ourselves, and lead a life where we are calming since we build control!
Conscientiousness
Same as above, for O(rganized) and U(nstructured). Relatively simple to identify, applicable in daily life.
There’s a lot more O’s than U’s, which I’m also surprised about? There’s also the most X’s in TABLENUM, compared to others. The X’s, I think, can be explained since people fluctuate between having super organized lives, but a messy desk? It’s easy to be both organized and unorganized. As for the large amount of O’s… It’s clearly not represented as much in TABLENUM, considering there’s basically an equal number of each response. It could be because people want to see themselves as organized, or they think they’re organized (e.g. they know where everything is on their desk, but items are actually strewn all over), when in reality, they aren’t! A good thought to carry for the next two personality traits.
Agreeableness
This is where it gets a bit funny! There is not a SINGLE E(gocentric) - it’s just a sea of A(greeable). This is probably because this is a self-administered test, people want to be seen as agreeable in society (correlated with ‘niceness’), and people are biased.
Let me tell you a story that I heard from a TEDTalk. There’s this guy, I think he’s a magician, and he’s at the airport waiting. Something bad has happened that I can’t recall: Maybe his flight has been delayed by 2 hours, or he really needs a refund, or he’s lost his luggage. So, he calls their airline, and the customer representative is clearly in a bad mood, maybe a little bit angry or grouchy, and he’s getting nowhere with his request. The guy hears her voice, and realizes: “Oh, the representative must think that I’M so lucky (despite how she sounds) that I’M talking to her, because she’s taking SO MUCH TIME out of HER day to help me.” So, the guy goes “Hey! I really appreciate you for helping me, and I’m really grateful that I’m talking to you!” The flight attendant INSTANTLY is in a better mood, and becomes genuinely helpful, and ends up solving his request, after he acknowledges her struggles and actually is really kind to the flight attendant, who’s far more used to being yelled at!
So, aside from being a heart-warming story, it also serves to prove two things:
- People are biased. Most of the time, we think that WE’RE the good people, when we objectively aren’t.
- We like being liked. We can show this through helping others, as seen by the flight attendant’s resolve after being appreciated.
So, it makes sense why, if we’re inputting our own answers without requiring proof, people can naturally skew themselves into thinking that they’re nicer than they actually are. I think the same concept applies to agreeability - we like to think that we’re agreeable, because it’s correlated with niceness, and we like being nice. Not only that, but we want to be liked, and oftentimes, by agreeing with others, people have a nicer opinion of us! Lastly, it’s a lot easier to agree with others, than to go against the status quo. Maybe people do disagree, but they’ve just repressed their own thoughts because… society.3 The opposite also applies to egocentrism - nobody wants to call themselves egocentric, as it’s associated with narcissism and self-centeredness. They’re traits that nobody wants. Not only that, but who wants to admit that they agree with “I feel little concern for others.”
Openness
It’s anti-egocentrism part 2, except this time, people are refusing to call themselves non-inquisitive! In fact, it’s even worse than before, if you look at TABLENUM! Once again, it goes back to the same ideas:
- People are biased, and that will significantly skew results if this is a self-administered quiz
- People don’t like being seen as ‘non-inquisitive’, because it often has negative connotations relating to ‘not being smart’ or ‘being uninteresting’. The opposite can be said with people being seen as ‘inquisitive’. Who wants to admit that they’re NOT “quick to understand things.”
However, I think one major point that Openness has that Agreeability doesn’t, is just the fact that taking a Big Five personality quiz, inherently means that you’re going to be more inquisitive. If you weren’t curious about it in the first place, you just… wouldn’t take the quiz or care about the result. Hence, there’s some sample bias, as the people you’re getting results from, are already skewed towards inquisition. In addition, psychology is seen as something ‘nerdy’ and scientific, which caters to ‘smarter’ or ‘more educated’ audiences.
Hence, someone might agree with “I have a rich vocabulary”, not because they’re interested in learning new words, but just because they perceive themselves as having a lot of knowledge due to their education. Or answer a 1 (disagree) to “I have difficulty understanding abstract ideas” or a 5 (agree) to “I am full of ideas” because, through education, they’ve trained themselves to be better at comprehending abstract ideas or becoming better at brainstorming.
Sheer Statistical Impossibility…?
However, When analyzing this data, it seems.. strange that so many XXOAI types are represented. In fact, it feels weird that 15%(!!!!) of people were the EXACT SAME TYPE, despite ALL THE POSSIBILITIES!
So, let’s see how it compares to other, more theoritical, data. Using the data4 from SimilarMinds, we can see how our data stacks up.
|
|
Looking at these tables, there’s a clear discrepancy between theoretical and experimental data, where none of the theoretical results really match up to what is seen in our data set. However, most of it can be explained by the previous analysis: Wrong results might occur because of bias and societal norms (cementing the last two letters to be A and I), in addition to the natural disposition of responders. This comparison really just showcases how there’s a high likelihood of bias.
Honestly, I’m not too sure why 15% of people are SCOAI, maybe people are being influenced to answer what they WANT to be like, rather than what they actually are, since SCOAI seems like one of the most ‘socially-successful’ results. But, in reality, responders aren’t actually SCOAIs. That’s my best guess!5
Also, if you’re interested, here’s a list of the most uncommon results!
| Results | Amount of Responses |
|---|---|
| SLXXX | 1 |
| XLUXX | 1 |
| XLXXX | 1 |
| XXOXX | 1 |
| XXUXN | 1 |
| XXXXN | 1 |
| RXXEX | 2 |
| RXXXX | 2 |
| SXXEN | 2 |
| SXXXN | 2 |
No surprise, it’s a lot of results with X’s. It’s pretty hard to get an X, because you’re perfectly in between!
At first, I was surprised that ‘XXXXX’ didn’t appear, since it’s technically the most unlikely.6 However, I wouldn’t be surprised if only 5% of those results were genuine user responses, and the other 95% were just people who kept clicking 3 (Neutral), or had some kind of game to see if they could perfectly answered the questions to get XXXXX.
Do results vary between countries?
This data from 224 unique locations/contains 224 different ISO country codes.7 Let’s dig through this data - a fun bit of stalking!
We can see that the majority of data came from the US, with a whopping total of 546403 respondents. Followed behind them is Great Britain (GB), Canada (CA), and Australia (Au). This is likely because this quiz is in English, and will generally cater towards countries with English as their primary language.
Google’s SEO (Search Engine Optimization) is also affected by location, and can rank websites by their proximity to the user8. So, it’s possible that Open Psychometrics is American9, and when Americans search up “Big Five Personality Test”, this is the first quiz that shows up.10
But, we’re not really concerned on WHERE people are taking the quiz, but how it affects answers. Hence, I’m going to find the top 5 most popular results for America, Great Britain, Australia, and the Philippians–top results from different continents–and seeing how they compare to one another.
|
|
|
|
From this table, it’s pretty clear that the countries generally have similar results, but Philippines is the only one that really stands out from the rest. Namely, the country has more RLAOI than SCOAI, meaning respondents tended to be more limbic and introverted than their counterparts. It’s difficult to point out why without knowing the average age of the respondents, as that could dictate a lot of their behaviors.
However, this also shows these countries follow the trend - every single one of the results were inside the top 25. Of course, this is the expected result, but one can always wish for a little special surprise, you know?
Are All Questions Created Equal?
We can also analyze the questions themselves. A funky little thing that this quiz did, was record how many milliseconds each respondent spent on each question. That seems like a fun thing to look at….
Thus, I present to you: General time spent on each question!
This is a good visual to compare questions to each other, especially questions in the same category.
For your reference:
- EXT = Extroversion (S/R)
- CSN = Neuroticsm (L/C)
- EST = Organization (O/U)
- AGR = Agreeableness (A/E)
- OPN = Openness (I/U)
For those unaware, this is a box plot11. The white box symbolizes the interquartile range, with the lower half of the box showing the bottom 25%, while the top half of the box shows the top 25%. The line in the center is the median of the question. It’s really good for visualizing the spread of data (which seems to range quite a bit). However, I’ve skewed the data by cutting off any values above 20 seconds12 and only took a random sample of 500 response times for each question13.
However, I want to be more precise with these loading times, so I’ve specifically pulled the questions that take the longest and shortest times to complete.
|
|
I’ve taken the liberty of removing EXT_1 (the first question on the quiz), which had an average score of 87 seconds. This is likely because people people were getting accustomed to the quiz, had loading time issues, or started the quiz, then immediately forgot about it.
“I shirk my duties” took the longest, likely because ‘shirk’ is an uncommon word and people wanted to search up the definition, which easily could’ve taken an extra 10 seconds. As for the other questions, they’re all relatively long sentences and have more nuance. They’re all very situational, as people are rarely “always relaxed” or “never relaxed”, and it takes time to think whether you’re relax a MAJOURITY of the time. Same thing for little concern for others - there are tons of people you care about, but also, tons of people you don’t. So, it’s a bit tricky to answer those.
On the other hand, the questions that took the least amount of time are short and straightforward, and are obvious to judge yourself on. You either read a dictionary for fun to seem smart, or you don’t. I do find it interesting that it’s difficult for people to determine whether they’re ‘relaxed’ rather than ‘blue’. Likely because you conciously pay attention to when you’re sad, but not when you’re relaxed? You can also see that these questions are the ones that are asked later (e.g. AGR_9 is part of the 9th out of 10 rounds of questions, meaning that it’ll be really close to the ending of the quiz). Anticipation for results may have caused them to rush through the later questions.
Another interesting thing to note is the distrubtion of answers for each question. You may expected that each question has a distribution similar to standard deviation. However… that’s actually not the case! Many questions tend to have a distribution like so:
# A tibble: 10,069,172 × 2
Question Answers
<chr> <dbl>
1 EXT1 4
2 EXT2 1
3 EXT3 5
4 EXT4 2
5 EXT5 5
6 EXT6 1
7 EXT7 5
8 EXT8 2
9 EXT9 4
10 EXT10 1
# ℹ 10,069,162 more rows
# A tibble: 1,008,601 × 2
Question Answers
<chr> <dbl>
1 AGR1 2
2 AGR1 1
3 AGR1 1
4 AGR1 2
5 AGR1 1
6 AGR1 2
7 AGR1 1
8 AGR1 2
9 AGR1 1
10 AGR1 5
# ℹ 1,008,591 more rows
# A tibble: 1,007,186 × 2
Question Answers
<chr> <dbl>
1 EXT8 2
2 EXT8 5
3 EXT8 3
4 EXT8 4
5 EXT8 5
6 EXT8 3
7 EXT8 3
8 EXT8 2
9 EXT8 2
10 EXT8 4
# ℹ 1,007,176 more rows
# A tibble: 1,006,170 × 2
Question Answers
<chr> <dbl>
1 EST8 2
2 EST8 1
3 EST8 2
4 EST8 2
5 EST8 1
6 EST8 1
7 EST8 2
8 EST8 1
9 EST8 2
10 EST8 3
# ℹ 1,006,160 more rows
# A tibble: 1,007,122 × 2
Question Answers
<chr> <dbl>
1 CSN2 4
2 CSN2 2
3 CSN2 2
4 CSN2 4
5 CSN2 1
6 CSN2 2
7 CSN2 2
8 CSN2 1
9 CSN2 3
10 CSN2 5
# ℹ 1,007,112 more rows
The neuroticism table was actually calculated differently. For the other 4 traits, there were an equal number of ‘positive (e.g. extroversion) questions’ and ‘negative (e.g. introversion) questions.’ Neuroticism had 2 ‘positive’ questions and 8 negative questions. So, subtracted 3 from each result, where a score of 5 (Agree) became +2, and a score of 1 (negative) became -2. This helped balance the questions, while using a similar process. I tried using this method with the other tables and got the same values as my previous method, which is good to see!↩︎
The average values will actually shift every time you refresh this webpage, as I found a function to randomly grab 100 people, then take the average!↩︎
I use agreeableness pretty synonymously with niceness. One can critique that isn’t the case, and that agreeability and niceness are more distinct than I make them out to be. That can absolutely be the case, and the story is not relevant. However, the point about society preferring agreeability still stands, and society will still influence how you act and how you perceive yourself.↩︎
This was the only site that had theoretical values. I don’t know where they got their percentages from, and there was also no data on certain combinations. It should also be noted that this site does not use ‘X’ as a possible result. E.g. XLUEI (or any combination with an ‘X’) is not considered. So this source can not be completely trusted. It should also be noted that SimilarMinds separated the theoretical values by female and male. Since this data set does not have this distinction, I used the average of the male and female theoretical values.↩︎
If you have more ideas, I’d love to hear them! Reach out :)↩︎
There’s actually 3794 results for XXXXX↩︎
‘Country codes’ are kinda misleading. There are ~195 countries, and ISO has 249 different codes. This is because the ISO contains subdivisions of countries, e.g. Caymen Islands (UK), Christmas Island (Australia), and the Holy See.↩︎
https://www.searchenginejournal.com/ranking-factors/physical-proximity-to-searcher↩︎
I couldn’t find any location data on the website itself↩︎
As a Canadian, it’s actually the third search result!↩︎
I actually forgot this type of graph existed, until I was randomly scrolling through the ggplot2 library of different graph types!↩︎
as it’s quite uncommon and makes plotting the graph difficult↩︎
500 is enough to show the general trend, and utilizing more only makes graphs take longer to load.↩︎